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ABSTRACT 



The present invention enables to establish a safe multiplex 
schedule, eliminating a signal deterioration even when a 
delay amount in a coded signal buffer is reduced. 

An input video signal from a terminal 10 is supplied to a 
frame memory 11. An image coding controller 12 reads in a 
video signal Sll from the frame memory 11 and calculates 
an assignment coding bit amount S12 for coding each of the 
pictures and a picture coding parameter S17. A video 
encoder 13 executes a coding processing according to these 
information items S12 and S17. The assignment coding bit 
amount S12 and the coding parameter S17 are also supplied 
to a multiplex scheduler 22 where a multiplex schedule is 
established so as to prevent destruction of a buffer of a 
decoder side. 
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calc_DTS_and_PTS() { 

prev_repeat_f irst_f ield = 1 ; 
delta = 1/29. 97; 
TS = DTSO; 
i = 0; 

while (I ! = End_Of_File) { 
DTS[i] = TS; 

if (picture_coding_type [i] == "B") { 
PTS[i] = TS; 

TS = TS + delta*(repeat_first_field[i]+2)/2; 

} 

else { 

if (i! = 0) PTS[prev_IP] = TS; 
TS = TS + delta*(prev_repeat_first_field + 2)/2; 
prev_repeat_first_field = repeat_first_field[i]; 
prev_IP = i; 

} 

} 

PTS[piev_IP] = TS; 



FIG.8 
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DIGITAL SIGNAL CODING METHOD AND 

APPARATUS, SIGNAL RECORDING 
MEDIUM, AND SIGNAL TRANSMISSION 
METHOD FOR RECORDING A MOVING 
PICTURE SIGNAL AND AN ACOUSTIC 5 
SIGNAL 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 10 
The present invention relates to a digital signal coding 

method and apparatus, a signal recording medium, and a 
signal transmission method and in particular, to a digital 
signal coding method and apparatus, a signal recording 
medium, and a signal transmission method which can pref- 15 
erably be applied for a case of recording a moving picture 
signal and an acoustic signal on a recording medium such as 
a magneto-optical disc and a magnetic tape and reproducing 
the signals to be displayed on a display or for a video 
conference system or a broadcast apparatus for transmitting 20 
a moving picture signal and an acoustic signal from a 
transmission side to a reception side via a transmission path, 
so that the signals are received and displayed at the reception 
side. 

25 

2. Description of the Prior Art 

A digital signal obtained by digitizing a moving picture 
signal, an acoustic signal, or the like has a plenty of 
information amount. Consequently, when recording the digi- 
tal signal on a recording medium having a small storage 30 
information amount for a long period of time, or when 
transmitting the digital signal through a limited communi- 
cation path with a plenty of channels, it is indispensable to 
provide means for coding the digital signal with a high 
efficiency. In order to answer such a requirement, there have 35 
been suggested high-efficiency coding methods using a 
correlation of a video signal. One of the methods is the 
MPEG method or MPEG specification. The MPEG (Moving 
Picture Image Coding Experts Group) was discussed and 
proposed as a standard plan in the ISO-IEC/HTC1/SC2/ 40 
WG11. The MPEG specification is a hybrid method using a 
motion compensative predictive coding and a discrete cosine 
transform (DCT) in combination. In this MPEG method, 
firstly a video signal difference between frames is deter- 
mined so as to remove a redundancy in the time axis 45 
direction and the discrete cosine transform is used to remove 
a redundancy in the spatial axis direction, thus enabling to 
encode a video signal with a high efficiency. 

The MPEG specification consists of three parts: the 
MPEG video (ISO/IEC11172-2 or IS0/IEC13818-2) for a 50 
high-efficiency coding of a video signal; the MPEG audio 
(ISO/1EC11172-3 or ISO.IEC13818-3) for a high-efficiency 
coding of an audio signal; and the MPEG system (ISO/ 
IEC11172-1 or ISO/IEC13818-1) for multiplexing com- 
pressed video and audio bit streams into a single bit stream 55 
and reproducing the stream with synchronization. 

FIG. 1 is a block diagram showing a configuration 
example of a digital signal coding apparatus of a conven- 
tional MPEG method. Here, a feed forward control is carried 
out for determining an assignment (target) bit amount for 60 
each of input pictures when coding an input video signal. 
That is, a video signal S101 inputted from a terminal 200 is 
supplied to a frame memory 201. The frame memory 201 is 
capable of storing a predetermined length of an input video 
signal. Here, the predetermined time length is, for example, 65 
0.5 seconds (15 frames in the case of NTSC). An image 
coding controller 202 reads a video signal Sill from the 
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frame memory 201 and, for coding each of the pictures, 
calculates an assignment bit amount S112 and a picture 
coding parameter S117. More specifically, an assignment bit 
amount for a predetermined time length of a video signal is 
optimally distributed according to the images of the respec- 
tive pictures. A video encoder 203 encodes a picture S102 
supplied from the frame memory 201 according to the 
coding parameter S1T7, so that the picture S102 has the 
assignment bit amount S112 supplied from the image coding 
controller 202, and outputs a coded bit stream S103 of the 
picture S102 and a generated coding bit amount S113. The 
coded bit stream S103 is supplied to a buffer 204 and to an 
access unit detector 201. Moreover, the generated coding bit 
amount S113 outputted from the video encoder 203 is 
supplied to the image coding controller 202. In the image 
coding controller 202, if the generated bit amount is greater 
than the assignment bit amount, control is made so as to 
make the next assignment bit amount smaller; and if the 
generated bit amount is smaller than the assignment bit 
amount, control is made so as to make the next assignment 
bit amount greater. 

An audio signal S105 inputted from a terminal 205 is 
supplied to an audio encoder 206. The audio encoder 206 
encodes the input audio signal S105 on audio frame basis by 
way of the MPEG audio method and outputs a coded bit 
stream S106 to a buffer 207 and to the access unit detector 
211. Here, one audio frame consists of 1152 samples in the 
case of the MPEG audio layer 2. 

A sub picture signal S108 such as a superimpose infor- 
mation inputted from a terminal 208 is supplied to a sub 
picture encoder 209. The sub picture encoder 209 encodes 
each sub picture by way of the Run Length method, for 
example, and outputs a coded bit stream S109 obtained to a 
buffer 210 and to the access unit detector 211. 

The access unit detector 211 detects a coding bit amount, 
a decoding time information, and a display time information 
of an access unit (decoding unit) of the video, audio, and sub 
picture coded bit streams and outputs the obtained informa- 
tion as an access unit information S114. Here, the access unit 
is one picture of a video signal, one frame of an audio signal, 
and one picture of a sub picture signal. 

The video bit stream, the audio bit stream, and the sub 
picture bit stream are time-division multiplexed by the 
MPEG system method. The bit streams which have been 
multiplexed by the MPEG system method is formatted, for 
example, as shown in FIG. 2. In this FIG. 2, V A, S 
respectively represent a video bit stream packet, an audio bit 
stream packet, and a sub picture bit stream packet. A packet 
has a configuration having a header information consisting 
of a decoding time information, display time information, 
and the like which is followed by a coded bit stream. 

A multiplex scheduler 212, according to the access unit 
information S114, determines a schedule information S115 
for time-division multiplexing the video, the audio, and the 
sub picture coded bit streams. 

That is, the MPEG system method defines a system target 
decoder (STD) which is a virtual decoder model as shown in 
FIG. 3, and the multiplexed bit stream should be encoded 
while maintaining this system target decoder. This system 
target decoder (STD) shown in FIG. 3 will be detailed 
below. 

In FIG. 3, a multiplexed bit stream is inputted from a 
terminal 301, and a switch 302, from this stream, isolates a 
video bit stream packet, an audio bit stream packet, and a 
sub picture bit stream packet, which packets are respectively 
supplied to a buffer 303, a buffer 305, and a buffer 307. A 
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video decoder 304, an audio decoder 306, and a sub picture 
decoder 308 read out an access unit from respective buffers 
according to the decoding time information of the access 
unit of the coded bit streams stored in the respective buffers, 
and decode the access unit, so as to reproduce with syn- 5 
chronization the video , the audio, and the sub picture 
according to the display time information of the access unit. 
Here, the multiplexed bit stream should be coded so as to 
maintain the system target decoder, preventing overflow and 
underflow of the buffer 303, the buffer 305, and the buffer no 
307. The buffer overflow means that a bit stream storage 
amount exceeds a buffer capacity; and the buffer underflow 
means that an access unit is not entirely stored in the buffer 
by the decoding time of the access unit. 

FIG. 4 shows a transition of a bit occupation in the STD 15 
buffer. In this FIG. 4, B represents a size of the STD buffer, 
and the vertical axis represents the buffer bit occupation 
amount or a data amount. A data input to the STD buffer is 
carried out with an input rate indicated by the inclination of 
the straight line ascending rightward, which increases the bit 20 
occupation amount. Moreover, in this figure, each of the 
access units A is instantaneously removed from the STD 
buffer at a corresponding decoding time DTS (decoding time 
stamp), which decreases the buffer bit occupation amount. 
The trace of the STD buffer bit occupation amount should be 25 
within the buffer size B, 

The multiplex scheduler 212 of FIG. 1 determines a 
multiplex schedule of the video, audio, and sub picture 
coded bit streams, so as to prevent destruction of the system 
target decoder (STD), and outputs the information S115 to a 30 
multiplexer 213. That is, the multiplex scheduler 212 simu- 
lates the STD buffer bit occupation amount and determines 
the multiplex scheduler so as to prevent the buffer overflow 
and underflow. The mutliplexer 213, according to a mutli- 
plex schedule information S115, reads out bit streams S104, 35 
S107, and S110 from the buffer 204, buffer 207, and buffer 
210, respectively, and multiplexes the bit streams by way of 
time division, so as to output a multiplexed stream Sll 6. 

In the MPEG video method, it is possible to change a 4Q 
generated bit amount for each picture as well as a video 
coding bit rate and accordingly, the packet cycle of the 
video, audio, and sub picture in the multiplexed bit stream 
is not always constant. Generally, when determining a 
multiplex schedule of a current video packet, i.e., when 45 
establishing an input schedule of a current coding picture 
(access unit) to the system target decoder (STD), consider- 
ation is also taken on an information of a coding picture to 
be inputted to the system target decoder in future, which 
enables to obtain a save control. 

50 

That is, in FIG. 4, for example, in order to determine a 
video input schedule (input rate) to the STD buffer in a time 
window from the DTS[n-l] to DTS[n], it is preferable to 
consider an information A[n] of coding of a current picture 
and an information of coding of several frames in future 55 
A[n+1], A[n+2] . . . DTS[n+l], DTS[n+2] . . . That is, in this 
case, by considering not only the multiplex schedule of the 
time window DTS[n-l] to DTS[n] but also a multiplex 
schedule of the future, it is possible to secure a safe coding 
of a multiplexed stream. 60 

For this, it is necessary to store a plurality of coded 
pictures (access units) in the buffer 204 and between the 
signals S1G3 and S104 there is often a delay amount 
corresponding to several frames required for determining the 
multiplex schedule. 65 

FIG. 5 shows an example of a timing chart of a video 
signal processing in the digital signal coding apparatus of 
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FIG. 1. Here, PI to P10 represent pictures or their picture 
information. In this example, it is assumed that the feed 
forward control for determining an assignment coding bit 
amount for coding an input video is carried out to first five 
pictures in the future including a current picture. That is, in 
the frame memory 201, the input video signal S101 is 
delayed by a 5-picture time. Moreover, it is assumed that in 
order to determine a multiplex schedule of a current coding 
picture, a coding information on the first 5 pictures including 
a current picture is considered. That is, in the buffer 204, a 
delay of 5-picture time is required. 

Here, as shown in FIG. 5, for the input video signal S101, 
the assignment coding bit amount S112 is delayed by 
5-picture time. If it is assumed to ignore a delay amount in 
the encoder 203, the Sll, the input picture S102 to the 
encoder 203, and the coded picture S103 are synchronized. 
Next, for the coded picture S103, the multiplex schedule 
information S115 is delayed by a 5-picture time. If it is 
assumed to ignore a delay in the multiplexer 213, the SU5, 
the coded picture S104 which is read out from the buffer 
204, and the multiplexed output S116 are synchronized. 

Now, in the conventional digital signal coding apparatus 
of FIG. 1, the delay amount of the multiplexed bit stream 
Sll 6 for the input video signal S101 mainly consists of a 
delay amount in the frame e memory 201 for calculating the 
assignment coding bit amount of a picture and a delay 
amount in the buffer 204 for the multiplex schedule calcu- 
lation. 

Generally, as the delay amount in the frame memory 201 
fro calculation of the assignment coding bit amount 
increases, it is possible to drastically change the assignment 
coding bit amount of an input picture, enabling to obtain a 
coded picture of a high quality. However, this is accompa- 
nied by a greater delay amount in the buffer 203 for the 
multiplex schedule calculation, requiring a grater size (bit 
amount) of the buffer 204. 

For this, conventionally, when it is desired to decrease the 
delay amount of the multiplexed bit stream S116 for the 
input video signal S101, the delay amount in the frame 
memory 201 or in the buffer 204 has been made small. 
However, if the delay amount in the frame memory 201 is 
made small, there arises a problem that the coded picture 
quality is deteriorated. Moreover, if the delay amount in the 
buffer 204 is made small, there arises a problem that it 
becomes difficult to establish a safe multiplex schedule. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide 
a digital coding method and apparatus, a signal recording 
medium, and a signal transmission method which enable to 
reduce a delay amount of an output multiplexed bit stream 
with respect to an input digital signal in comparison to a 
conventional digital signal coding apparatus as well as to 
obtain a coded picture of a high quality and to establish with 
safety a multiplex schedule for multiplexing coded bit 
streams. 

In order to achieve the aforementioned object, the present 
invention is characterized in that when coding an input 
digital signal such as a video signal and an audio signal and 
multiplexing coded bit streams into a single bit stream, a 
coding control information for coding the input digital signal 
of a predetermined unit interval is adaptively determined 
and a multiplex schedule is controlled according to this 
control information, for multiplexing the coded bit stream. 

Here, the coding control information includes an assign- 
ment coding bit amount and if the input digital signal is a 
video signal, the unit interval is a picture. 
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Because the multiplex schedule control is based not on an assignment bit amount S12 for coding respective pictures 

information such as a coding bit amount of an already coded and coding parameter S17 of the picture. More specifically, 

signal but on the coding control information for coding, it is an assignment bit amount for a predetermined time length of 

possible to reduce a memory capacity of a buffer which a video signal is optimally distributed according to images 

stores a coded signal. 5 m tne respective pictures. Moreover, as the picture coding 

parameter, there can be exemplified picture_codin&_type, 

BRIEF DESCRIPTION OF THE DRAWINGS repeat_first_field, and top_field_first_defined in the 

MPEG video specification. 

FIG. 1 is a block diagram showing a configuration The aforementioned picture_coding„type_which is one 

example of a conventional digital signal coding apparatus. ^ D f the coding parameters S17 has three types of picture: I 

FIG. 2 shows a multiplex bit stream format when a video picture, P picture, and B picture. The I picture is an intra- 

bit stream, an audio bit stream, and a sub picture bit stream coding picture which is coded independently of the other 

are time-division multiplexed by the MPEG system method. pictures. The P picture is a forward predictive coding picture 

FIG. 3 is a block diagram showing a configuration and coded through prediction from an I picture or a P picture 

example of a system target decoder defined in the MPEG 15 wmch / s positioned temporally in the past. The B picture is 

system method a bi-directional predictive coding picture which is coded 

HO. 4 shows a transition of a bit occupation ratio of a ' b ™ Ugh P r ' diction £y using an I or P picture preceding and 

• l , ~ r following temporally, in the forward direction, backward 

video STD buffer. ° . r . r™ A „ . , - ' 

direction, or two directions. The top_Jeld_first is a param- 

FIG. 5 shows an example of a timing chart of a video eter indicating which of top_field and bottom_field is to be 

signal processmg in the digital signal coding apparatus of 20 dispUved when a picture fc in a frame configuration at the 

FIGl reception (decoder) side. The repeat_first_field is a param- 

FIG. 6 is a block diagram showing a configuration eter indicating whether to repeatedly display the field first 

example of a digital signal coding apparatus according to an displayed when the picture is in a frame configuration at the 

embodiment of the present invention. reception (decoder) side. 

FIG. 7 shows relationships of the picture coding param- A video encoder 13 encodes a picture S2 supplied from 

eters picture_coding_type, repeat _first _field with the the frame memory 11 according to the coding parameter S17 

DTS, PTS. by way of the MPEG video method, so as to correspond to 

FIG. 8 shows an example a program for DTS and PTS tne assignment coding bit amount S12 supplied from the 

calculation by using picture coding parameters picture_ 30 i^ge coding controller 12, and outputs a coded bit stream 

coding_type, repeat_first_field, and top_field_first. s3 of tne picture S2 and a generated coding bit amount S13. 

FIG. 9 shows an example of a timing chart of a video ™ e coded bl ] stream ?? * supplied to a buffer 14 and to an 

signal processing in the digital signal coding apparatus of access ™ l1 deteclor 2 }: Moreover, the video encoder 13 

FIG g outputs a generated coding bit amount S13 which is supplied 

oi^ m ■ « u - r 1 * • 1 r « t0 tne image coding controller 12. In the image coding 

1 <u f 15 * mT h expla T 8 t ^ eXampl t ? coatroUer U, if the generated bit amount is greater than the 

a gonthm for establishing a video signal multiplexing sched- assignment bit a control fc made t * make ±t Qext 

u e * assignment bit amount smaller, and if the generated bit 

FIG. 11 is a block diagram showing a configuration amount is smaller than the assignment bit amount, control is 

example of a moving picture signal coding block 25 in the ma de to make the next assignment bit amount greater, 

digital signal coding apparatus of FIG. 6. ^ frame memory u me ^ codiDg controller 12> 

DETAILED DESCRIPTION OF PREFERRED and ^ e encoa<er 13 constitute a moving picture signal 

EMBODIMENTS coding block 25. A specific example of this moving picture 

coding block 24 will be detailed later with reference to FIG. 

Hereinafter, description will be directed to a digital signal 45 11. 

coding method and apparatus, a signal recording medium, i Q FIG. 6, an audio signal S5 inputted from a terminal 15 

and a signal transmission method according to preferred is supplied to an audio encoder 16. The audio encoder 16 

embodiments of the present invention. encodes the input audio signal S5 on frame basis by way of 

FIG. 6 is a block diagram showing a configuration the MPEG audio method and outputs a coded bit stream S6 

example of a digital signal coding apparatus which employs 50 to a buffer 17 and to the access unit detector 21. Here, one 

the digital signal coding method according to an embodi- audio frame corresponds to 1152 samples in the case of 

ment of the present invention. In this embodiment, unlike MPEG audio layer 2. 

the conventional digital signal coding apparatus of the A sub picture signal S8 such as a superimpose information 

aforementioned FIG. 1, an image coding controller 12 inputted from a terminal 18 is supplied to a sub picture 

supplies an assignment coding bit amount information S12 55 encoder 19. The sub picture encoder 19 encodes each of the 

of a picture and a coding parameter S17 of a picture to a sub pictures by way of Run Length method, for example, 

multiplex scheduler 22, so that the multiplex scheduler 22 and outputs its coded bit stream S9 to a buffer 20 and to the 

establishes a multiplex schedule by using the aforemen- access unit detector 21. 

tioned assignment bit amount information S12 and the The access unit detector 21 calculates each of the video, 

coding parameter S 17. 60 au di 0 , and sub picture coded bit streams: a coding bit 

In the embodiment shown in FIG. 6, a video signal SI amount, a decoding time information (DTS: decoding time 

inputted from a terminal 10 is supplied to a frame memory stamp), and a display time information (PTS: presentation 

11. The frame memory 11 can store a predetermined tie time stamp) of an access unit (decoding time) and outputs 

length of an input video signal. Here, the predetermined time the obtained information as an access unit information S14. 

length, for example, is 0.5 seconds (15 frames in the case of 65 Here, the access unit is one picture of a video signal, one 

NTSC). The image coding controller 12 reads in a video frame of an audio signal, and one sub picture of a sub picture 

signal Sll from the frame memory 11 and calculates the signal. 
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Next, FIG. 7 shows relationships between the picture_ 
coding_type__, repeat_first_field and DTS, PTS. 

Hereinafter, explanation will be given on respective sig- 
nals A to I in FIG. 7. 

[A] moving picture input: The letter "F" of the upper case 
represents a top field of an interlace video, and the letter "f ' 
of lower case represents a bottom field of the interlace video. 
Here, an input signal is a video signal of a film image pulled 
down by 3-2. A pair of F and f having an identical subscript 
numeric corresponds to one frame of a film. 

[B] frame_input: A pair of top field and bottom field 
having an identical subscript starting at a field at a time 
moment when "1" is set constitutes a frame to be encoded. 
When coding a video signal which has been pulled down by 
3-2, a frame is created by removing a repeated field. For 
example, the fifth field Fl of A is a repetition of the third 
field Fl and accordingly excluded and not encoded. 

[C] repeat _first_field: "1" if top field at the timing when 
frame_Jnput_becomes "1"; and "0" if bottom field at the 
timing when frame_jnput__becomes "1". 

[D] repeat_first__field: Becomes "1" when a repeated 
field by the 3-2 pull down is excluded while creating a frame 
to be encoded. 

[E] picture_coding_Jype: The letters I, P, and B respec- 
tively correspond to an I picture, P picture, and B picture; 
and the subscript numeric correspond to the respective 
subscripts of A. 

[F] encoding time: I and P pictures which are positioned 
temporally later are encoded prior to a B picture and there 
order is changed as shown in the figure. 

[G] decoding time (DTS): The decoding order is identical 
to the encoding order. Here, it is assumed that encoding is 
carried out simultaneously with decoding. 

[H] display time (PTS): An image output is carried out in 
the original order. The B picture can be displayed immedi- 
ately after decoded. 

[I] moving picture output: Pictures are displayed accord- 
ing to the top__field_£rst and the repeat_Jirst_iield . 

Here, FIG, 8 shows a C language program as a specific 
example of algorithm for calculating the DTS and FTS by 
using the aforementioned picture coding parameters 
picture_coding_type, repeat_jirst_Jield, and top_field_ 
first. That is, the DTS and PTS of each of the pictures 
inputted in the encoding time order of FIG. 7F are calcu- 
lated. In this FIG. 8, the DTSO is a value related to the 
top_field_first_of the first picture BO. The 12 decoding 
time is set so that BO can be executed immediately after BO 
is decoded from the field parity time indicated by top_ 
field_first by TS=DTSO in the program. 

Back to FIG. 6 again, the multiplex scheduler 22 is 
supplied with the current access unit information S14 and 
information on a future access unit (picture), i.e., the assign- 
ment coding bit amount information S12 and the coding 
parameter S17. Thus, when establishing a multiplex sched- 
ule of a current access unit (coded picture), it is possible to 
consider a bit amount and an assignment parameter of a 
future access unit (coded picture) to be inputted in future. 
The multiplex scheduler 22 establishes a multiplex schedule 
for time-division multiplexing the audio and sub picture 
coded bit streams, so as to prevent destruction of the system 
target decoder, and outputs the obtained information S15 to 
a multiplexer 23. 

The multiplexer 23, according to the multiplex schedule 
information S15, reads out the bit streams S4, S7, and S10 
from the buffer 14, buffer 17, and buffer 20, respectively, and 
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multiplex them by time division, so as to output a multi- 
plexed stream S16 from a terminal 24. The multiplexed bit 
stream obtained from this output terminal 24, if necessary, is 
added with an error correction code and a synchronous 

5 signal, or subjected to a predetermined modulation process- 
ing for transmission or recording, and transmitted via a 
transmission path or a communication path, or recorded on 
a signal recording medium such as an optical disc, magnetic 
disc, magnetic tape, or the like. 

30 FIG, 9 shows an example of a timing chart of a video 
signal processing in the digital signal coding apparatus of 
FIG. 6. Here, PI to P 10 represent pictures or their informa- 
tion. Like the aforementioned conventional example of FIG. 
5 explained above, it is assumed that the first five future 

15 pictures including a current picture are subjected to the feed 
forward control for determining the assignment bit amount 
of each of the input pictures when coding an input video 
signal. That is, in the frame memory 11, the input video 
signal SI is delayed by five pictures. Moreover, it is assumed 

20 that in order to determine the multiplex schedule of a current 
coding picture, consideration is taken on coding information 
of the first five future pictures including a current picture. 

That is, the multiplex scheduler 22 reads in the current 
coded picture bit amount S14 detected in the access unit 

25 detector 21, and further the assignment coding bit amount 
S12 and the coding parameter S17 of the four future 
pictures, so that the multiplex schedule can be determined 
according to the S14, S12, and S17. Consequently, the delay 
amount required in the buffer 14 is only one -picture time, 

30 which significantly reduces the delay amount required for 
multiplexing in comparison to the conventional method. 

Here, as shown in FIG, 9, for the input video signal SI, 
the assignment coding bit amount S12 of the picture is 

35 delayed by a five -picture time. If the delay amount in the 
encoder 13 is assumed to be ignored, the S12, the input 
picture S2 to the encoder 13, and the coded picture S3 are 
synchronized. Next, for the coded picture S3, the multiplex 
schedule information S15 is delayed by one-picture time. If 

4Q the delay in the multiplexer 23 is assumed to be ignored, the 
S15, the coded picture S4 which is read out fro the buffer 14, 
and the multiplexed output S16 are synchronized. 

FIG, 10 is a flowchart for explaining a specific example 
of algorithm for establishing a video multiplexing schedule. 

45 In this FIG. 10, in the first step 500, a processing of the 
first picture is started, Here, "n" represents a picture input 
number after the order change into the encoding sequence. 
In the next step 501, the coding control information of the 
future five frames (five pictures) including the current frame 

50 P[n] to P[n+4], i.e., picture_codin&_type, repeaL_first_ 
field and top_field_first, are used to input the DTS and PTS 
of each picture calculated in the access unit detector 21, i.e., 
DTS[n] to DTS[n+4] and PTS[n] to PTS[n+4]. The next step 
502 inputs the assignment coding bit amount X[n+1] to 

55 X[n+4] of the future four pictures P[n+1] to P[n+4] supplied 
from the image coding controller 12. The next step 503 
inputs the coding bit amount A[n] of the current picture P[n] 
calculated in the access unit detector 21. 

Next, in step 504, considering that the coding bit amount 

60 A[n] of the current picture P[n] and the assignment bit 
amounts X[n+1] to X[n+4] of the future four pictures P[n+1] 
to P[n+4] are outputted from the STD buffer at the respective 
DTS, a schedule is established to input a video bit stream to 
the STD buffer in the time window from DTS[n-l] to 

65 DTS[n+4] without destroying the STD buffer. It should be 
noted that the DTS[-1] when n-0 is a time in the past by a 
predetermined start up delay amount from the DTC[0]. 
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As has been explained with reference to FIG. 4, in the the aforementioned Equation (1) from picture to picture is 

conventional method, for example, when establishing an observed so that if the change ratio is greater than a 

input schedule (input rate) for input of the video of the time predetermined threshold value, it is decided that there is a 

window DTS[n-l] to DTS[n+4] to the STD buffer, it has scene change, and the picture at the scene change is specified 

been necessary to obtain an information on the picture 5 t0 06 coded by the Intra picture of MPEG, 

coding bit amounts A[n] to A[n+4], which in turn requires a Moreover, the controller 42 calculates the assignment 

5-picture delay time from the picture encoding to the mul- coding bit amount S12 of a picture according to the motion 

tiplexing. In contrast to this, in the aforementioned ve 1 ct0 1 r Prediction residue supplied from the motion vector 

algorithm, a similar multiplex schedule can be established calculator 40 and the statistical value supplied from the 

by using the A[n] and the assignment bit amounts of future 10 I^' matK> ° calculator 41 Tlie assignment coding bit 

. °„ r * vr a ~\ C^Z • i amount or the picture is calculated as follows. The controller 

picnics al» l j io Am^j, wnicn requires omy one-piciure ^ M&les ; total D of the 

macro block motion vector 

delay time from the picture encoding to its multiplexing. prcdiction residucs Wllhin thc picturc md modifics thc 

Next, in step 505, during the time window DTS[n-l] to obtained value with a parameter a indicating the coding 

DTS[n], the video bit stream is inputted to the STD buffer deterioration remarkability, so as to obtain a picture coding 

according to the aforementioned schedule. This schedule 15 difficulty d as follows: 

information is supplied as the multiplex schedule informa- t/oDxa 

tion S15 in FIG. 6 to the multiplexer 23, and the multiplexer In general, for the human eye, the coding noise is more 

23 encodes the multiplex stream. In the next step 506, the remarkable at a flat portion of an image and less remarkable 

assignment bit amount A[n] of P[n] is outputted at time at a complicated portion of an image. Based on this 

DTS[n] from the STD buffer. In the next step 507, the "n" 20 principle, as the image dispersion value increases, the value 

is incremented and control is passed to a processing of the <* is made smaller, and as the dispersion value decreases, the 

next picture. That is, in step 508, if the processing of up to value a is made greater. It should be noted that when an 

the last picture is complete, the processing is terminated. m P ut image is subjected to Intra coding according to an 

Otherwise, control is returned to step 501. image coding mode (not depicted), it is preferable to use as 

FIG. 11 is a block diagram showing a configuration 25 the aforementioned value D, a within-picture total of dis- 

example of the moving picture signal coding block25 of the Persion values of the macro block signal calculated in the 

digital signal coding apparatus of FIG. 6. That is, the image ^formation calculator 41 The controller 42, for 

terminal 10 and the frame memory 11 of FIG. 6 correspond exam P le calculates a coding difficulty for five future pictures 

to the a terminal 30 and a frame memory 31 of FIG. 11, mcludmg the current picture and distributes the assignment 

respectively. The image coding controller 12 of FIG. 6 30 blt & vcn }° the 5 -P lcture according to the 

almost corresponds to a motion vector calculator 40, an codm S difficulty of the respective pictures, 

image information calculator 41, and a controller 42 of FIG. ^ A motlon compensation circuit 38 is provided with a 

11. The video encoder 13 of FIG. 6 almost corresponds to memor y and reads out a P™^™ macro block signal 

the remaining circuit portion of FIG. 11. from the ma B e memory according to a motion vector. A 

, ~ , . , „ „ 35 calculator 32 carries out an addition processing by using as 

A moving picture signal inputted from the terminal 3o of , ,- f - • , . . fi T • i *i_ 

*u- t^t/" 1 iv • v j . a. * n an add-on signal the input macro block signal from the 

this FIG. 11 is supplied to the frame memory 31. For f„ nma mamn „?n n „A ^ u* ♦ • iTu * 

i • *u c « i *i_ c frame memory 31 and as a subtraction signal the aforemen- 

example, m the case of FIG. 9 as an example, the frame f - . / „ ui~v ■ „ i <•„ , u 

r ', . L r „ ■ 4 rL tioned prediction macro block signal from the motion com- 

memory 31 has a capacity for five pictures. The motion iq * i i » j-rc L ... 

A aa i . ^ . . . , pensation circuit 38, so as to calculate a difference between 

vector calculator 40 reads out the moving picture signal „ n tUa • , lt „ ua u i „„j »u= i- , 

- it _ - j i i * ■? 40 me mput macro o block signal and the prediction macro 

from he frame memory 31 and ca culates its moUon vector bbck si , ^ QU ^ ^ ag 

and its predicnon residue for output. The motion vector dictjon resi(Jue macro blocksi d . „ should be noted t J t fa 

yoXyvhaxoo 40 calculates a motion vector on the so-called „ MM - » ■ , • j A T • 4 . , 

ui 1 /»*o i c 1 * • i \ u • a *• a case WDen an in put picture is coded as an I picture by 

MPEG macro block (MB: 16xl6pixels) basis. A motion n c \ . . t J 

4 , , 4 . v - A . , * i 4t . specification of picture_coding_type, the input macro 

vector detection is carried out by way of pattern matchmg _ ui„„i, i •* • / * u i i * M 

Li r c . 4 i_i i r™ , 45 block signal is outputted as it is from the calculator 32 

between a reference frame and a current macro block. Tha m ^ ediaion- ^ ^^^0^ predic . 

is as shown in an Express.on (1) g.v 6n below, a sum Ef of ^ residue maCfo ^ ^ , (of ^ ^ 

absolute values of differences between the current macro * . .js-rj* ■ 

, . , A r - i j i_i i • ir-r • -i signal if no prediction is executed) is fed to a DCT circuit 33. 

block signal A [i, l] and a macro block signal F [x+i, y+n T „ iU - r^r^r •# 11 *u t *• j j -*- 

r » « I.. . ✓ \ • ■ j m this DCT circuit 33, the aforementioned prediction resi- 

referenced by an arbitrary motion vector fx, y) is obtained. , rt . „ U1 , • , . . , A j. • . 

J 7 v ' JJ 50 due a macro block signal is subjected to a two-dimensional 

Ef=2\A[t, j]-F[xHy+j]\(i=Q to 15, j=Q to 15) (1) DCT - 

A quantization scale controller 43 outputs a quantization 

The motion vector calculator 40 of FIG. 11 uses the step to a quantizer 34, so that the generated coding bit 

coordinates (x, y) which minimize the aforementioned Ef as amount of the current picture is equal to the assignment 

a motion vector of the current macro block and outputs the 55 coding bit amount specified from the controller 42. A DCT 

Ef as a prediction residue of the motion vector. coefficient outputted from the DCT circuit is supplied to the 

The image information calculator 41 reads out a moving quantization circuit 34, so as to be quantized with a quan- 

picture signal from the frame memory 31 and calculates a tization scale specified by the quantization scale controller 

statistical value indicating remarkability of the coding dete- 43. The quantization circuit 34 outputs a quantized output 

rioration. This statistical value is determined by calculating 60 signal which is transmitted to a variable length coding 

a parameter representing an image flatness such as a macro circuit 39 and to a reverse quantization circuit 35. The 

block luminance signal distribution value. variable length coding circuit 39 carries out, for example, 

The controller 42 outputs picture_coding_type, top_ Huffman coding to the aforementioned quantized output 

field_first, and repeat_first_field as the picture coding signal. An output signal from this variable length coding 

parameters S17. The picture_coding__type is, for example, 65 circuit 39 is supplied to a generated bit amount counter 44 

a sum of prediction residues of the motion vector within a where a total of generated sign amount of the picture is 

picture. That is, a change of a sum D of the Ef calculated by calculated. 
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On the other hand, in the reverse quantization circuit 35, 
corresponding to the quantization step used in the quanti- 
zation circuit 34, carries out a reverse quantization to the 
aforementioned quantized output signal. An output from this 
reverse quantization circuit 35 is supplied to a reverse DCT 5 
circuit 36, where the prediction residue macro block signal 
is subjected to a reverse DCT processing to be decoded and 
supplied to a calculator 37. This calculator 37 is also 
supplied with a signal identical to the prediction macro 
block signal supplied to the aforementioned calculator 32. no 
The calculator 37 adds the prediction macro block signal to 
the aforementioned decoded prediction residue macro block 
signal, thus enabling to obtain a locally decoded image 
signal. The locally decoded image signal is stored in the 
image memory of the motion compensation circuit 38, so as 35 
to be used as a reference image for the next motion com- 
pensation, the coded bit stream S3 is outputted from a 
terminal 46. This bit stream is supplied to the buffer 14 of 
FIG. 6. The moving picture signal coding block 25 in the 
digital signal coding apparatus of FIG. 6 is thus constructed. 20 

According to the embodiment of the present invention 
explained above, in comparison to a conventional digital 
signal coding apparatus, it is possible to reduce a delay 
amount (memory amount) of an output multiplexed bit 
stream with respect to an input digital signal, simplifying the 25 
configuration, as well as to obtain a coded picture of high 
quality and establish a multiplex schedule with safety. 

Here, the multiplexed bit stream obtained from the output 
terminal 24 of the aforementioned FIG. 6 is added with an 
error correction code and a synchronous signal and, if 30 
necessary, subjected to a recording signal processing includ- 
ing a predetermined modulation, so as to be recorded on a 
signal recording medium such as an optical disc, magnetic 
disc, magnetic tape, and the like. A digital signal which is 
read out from the signal recording medium obtained is in a 35 
safe multiplex schedule established. 

Furthermore, when transmitting the multiplexed bit 
stream obtained from the output terminal 24 of the afore- 
mentioned FIG. 6, this bit stream is subjected, if necessary, 
to an addition of an error correction code and a synchronous 40 
signal as well as a transmission signal processing including 
a predetermined modulation, so as to be transmitted via a 
transmission path and a communication path. This digital 
signal transmission method also enables to obtain the same 
effect as in the aforementioned embodiment. That is, it is 45 
possible to obtain a effect to reduce a delay amount (memory 
amount) required for multiplexing, thus simplifying the 
processing and when the input digital signal is a video 
signal, it is possible to minimize the coded picture image 
quality deterioration and to establish a safe multiplex sched- 50 
ule when multiplexing coded bit streams. Furthermore, as 
the delay time until actual transmission of an input digital 
signal is reduced in comparison to a conventional method, 
there is also a merit that a time lag is reduced during a real 
time transmission including a news program. 55 

It should be noted that the present invention is not to be 
limited to the aforementioned embodiment but can be modi- 
fied in various ways within the scope of the invention. For 
example, a digital signal handled may be other than a 
moving picture signal, such as an audio signal and a sub 60 
picture signal. 

According to the present invention, an input digital signal 
is coded and when multiplexing coded bit streams into a 
single bit stream, a coding control information is adaptively 
determined for coding the input digital signal of a predeter- 65 
mined unit interval, so that this coding control information 
is used for controlling multiplex schedule when multiplex- 
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ing coded bit streams, thus enabling to control the multiplex 
schedule according to the coding control information for 
coding instead of an information such as a coded bit amount 
of an already coded signal. This significantly reduces a 
buffer memory capacity for storing a coded signal. 

That is, in comparison to a conventional digital signal 
coding, it is possible to reduce a delay amount of an output 
multiplexed bit stream with respect to an input digital signal 
and with the reduced delay amount, to maintain a high 
quality without a signal deterioration while establishing a 
multiplex schedule with safety. 

Especially in a case when an input digital signal includes 
a video signal, in a conventional method, several frames of 
delay is required in a buffer for establishing a safe multiplex 
schedule, whereas according to the present invention, it is 
possible to establish a safe multiplex schedule according to 
a coding control information of several frames obtained 
during coding such as a picture assignment coding bit 
amount information. 

Moreover, in the digital signal transmission method using 
this digital signal coding technique, in addition to the 
aforementioned effect, it is possible to reduce a delay time 
from the coding of an input digital signal until output of a 
multiplexed bit stream, which provides a merit to reduce a 
time lag in a signal real-time transmission such as in news 
broadcast. 

What is claimed is: 

1. A digital signal coding method comprising: 

a feed forward control step for adaptively determining a 
coding control information for coding an input signal of 
a predetermined unit interval; 

a coding step for coding said input digital signal accord- 
ing to said coding control information so as to obtain a 
coded bit stream; 

a control step for controlling a multiplex schedule for 
multiplexing said coded bit stream according to the 
coding control information of said input signal of said 
unit interval; 

wherein said control information includes current and 

future access unit information; and 
a multiplex step for multiplexing said coded bit stream 

according to said multiplex schedule. 

2. A digital signal coding method as claimed in claim 1, 
wherein said input digital signal includes a digital video 
signal and said unit interval is a picture which corresponds 
to one frame of said digital video signal. 

3. A digital signal coding method as claimed in claim 2, 
wherein said coding control information includes an assign- 
ment coding bit amount of said picture. 

4. A digital signal coding method as claimed in claim 2, 
wherein said coding control information includes a coding 
parameter of said picture. 

5. A digital signal coding apparatus comprising: 

feed forward control means for adaptively determining a 
coding control information for coding an input signal of 
a predetermined unit interval; 

coding means for coding said input digital signal accord- 
ing to said coding control information so as to obtain a 
coded bit stream; 

schedule means for controlling a multiplex schedule for 
multiplexing said coded bit stream according to the 
coding control information of said input signal of said 
unit interval; 

wherein said control information includes current and 

future access unit information; and 
multiplexing means for multiplexing said coded bit 

stream according to said multiplex schedule. 
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6. A digital signal coding apparatus as claimed in claim 5, 
wherein said input digital signal includes a digital video 
signal and said unit interval is a picture which corresponds 
to one frame of said digital video signal. 

7. A digital signal coding apparatus as claimed in claim 6, 5 
wherein said coding control information of said feed for- 
ward control means includes an assignment coding bit 
amount of said picture. 

8. A digital signal coding apparatus as claimed in claim 6, 1Q 
wherein said coding control information of said feed for- 
ward control means includes a coding parameter of said 
picture. 

9. A signal recording medium containing a multiplexed bit 
stream recorded, wherein said multiplexed bit stream is 15 
obtained while controlling a multiplex schedule for multi- 
plexing a coded bit stream according to a coding control 
information which has been adaptive ly determined for cod- 
ing an input signal of a predetermined unit interval and 
wherein said control information includes current and future 20 
access unit information. 
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10. A digital signal transmission method comprising: 

a feed forward control step for adaptively determining a 
coding control information for coding an input signal of 
a predetermined unit interval; 

a coding step for coding said input digital signal accord- 
ing to said coding control information so as to obtain a 
coded bit stream; 

a control step for controlling a multiplex schedule for 
multiplexing said coded bit stream according to the 
coding control information of said input signal of said 
unit interval; 

wherein said control information includes current and 
future access unit information; 

a multiplex step for multiplexing said coded bit stream 
according to said multiplex schedule; and 

a transmission step for transmitting said multiplexed bit 
stream after subjected to a signal transmission process- 
ing. 

* * * * + 
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